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Calculations  fo*  -arge  Markovian  finite  source,  finite  repair 
capacity  two-echelon  repairable  item  inventory  models  are  shown  to 
be  feasible  using  the  randomization  technique  and  a  truncated  state 
space  approach.  More  complex  models  (involving  transportation  pipe¬ 
lines,  multiple  item  types  and  additional  echelon  levels)  are  also 
considered. 


1.  INTRODUCTION 

Let  {X(t) ,  t  >  0}  be  a  continuous- time  time-homogeneous  Markov 
process  (CTMP)  on  a  finite  state  space  S  =  {l,2,...,m}  .  All  such 
Markov  processes  can  be  characterized  by  an  initial  distribution  T[(D) 
and  an  infinitesimal  generator 
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The  q^'s  are  transition  rates.  The  infinitesimal  generator  Q 
seems  to  be  the  most  natural  way  to  describe  the  stochastic  nature  of 
continuous  time  Markov  models  with  denumerable  state  spaces.  The  state 
probability  vector  at  time  t  is  denoted  ir(t)  =  (jn^(t),  •••» 

irm(t)3  ,  where  7Ts(t)  =  P0((t)  =  s)  ,  s  e  S  .  These  transient  probabil¬ 
ities  satisfy  the  Kolmogorov  forward  equation 

tr’(t)  =  ir(t)Q  ,  t>  0  .  (1) 

This  is  an  initial  value  system  with  tt ( 0)  given.  (See  [1,7,14]  for 
more  background  on  Markov  processes.)  It  is  apparent  that  for  processes 
with  large  state  spaces,  we  need  to  solve  very  large  systems  of  differ¬ 
ential  equations.  For  example,  a  two-base,  one-depot,  single-item  type, 
two-echelon  system  with  24  units  at  each  base  and  two  spare  units  at  the 
depot  has  a  state  space  of  106,875  possible  states,  requiring  the 
solution  of  106,874  simultaneous,  linear,  first-order  differential 
equations  in  106,874  unknowns. 

This  paper  presents  a  method  for  solving  Equation  (1)  for  certain 
models  with  large  state  spaces:  the  randomization  numerical  technique 
is  used  to  solve  a  truncated  version  of  Equation  (1).  This  makes  it 
possible  to  calculate  measures  of  interest  for  systems  which  are  even 
too  large  to  be  handled  by  applying  the  efficient  randomization  technique 
to  the  full  state  space.  This  then,  would  allow  the  modeling  of  such 
systems  as  an  aircraft  wing,  with  three  squadrons  and  two  echelons  of 
supply  and  repair,  or  a  fleet  of  gas  turbine  engine  ships  with  both  ship¬ 
board  and  shore  repair  capability. 
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The  paper  is  structured  as  follows:  The  randomization  algorithm 
is  reviewed  in  Section  2.  Multi-echelon  repairable  item  systems  are 
discussed  in  Section  3;  the  primary  goal  of  this  paper  is  to  investi¬ 
gate  the  transient  behavior  of  such  systems,  however  they  also  provide 
good  examples  for  illustrating  the  general  truncation  approach.  The 
full  state  space  of  a  particular  multi-echelon  system  is  described 
in  Section  4.  The  truncated  state  space  is  given  in  Section  5. 

The  problem  of  determining  a  good  level  of  truncation  is  discussed 
in  Section  6.  Some  numerical  results  are  given  in  Section  7.  More 
complex  models  are  discussed  in  Section  8;  these  include  systems 
with  transportation  delays,  multiple  items  and  higher  echelons. 

Section  9  contains  conclusions.  This  paper  extends  the  earlier  work 
of  Gross  and  Miller  [5]. 

2.  THE  RANDOMIZATION  ALGORITHM 

Any  Markov  process  X  on  a  finite  state  space  can  be  represented 
as  a  discrete  time  Markov  chain  (the  uniformized  embedded  chain)  "ran¬ 
domized"  by  a  Poisson  process.  Define 

P  =  Q/A  +  I  ,  where  A  =  max  q.  (2) 

izS  1 

and  I  is  the  identity  matrix;  P  is  a  stochastic  matrix.  Let 

(Y  ,  n  =  0,1,2, ... }  be  a  Markov  chain  on  S  with  transition  matrix  P 
n 

and  initial  distribution  tt(0)  .  Let  (N(t),  t  ^  0}  be  a  Poisson 

process  with  rate  A  which  is  independent  of  (Y  ,  n  =  0,1,2,...}  . 

n 

Then  ^fj(t)’  C  ^  ^  is  a  Markov  process  with  generator  Q  and 
initial  distribution  tt (0 )  and  hence  is  probabilistically  identical 
to  {X(t),  t  ^  0}  .  This  construction  makes  it  possible  to  compute 
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transient  probabilities  of  a  Markov  process  with  generator  Q  from 
transient  prob  xlities  of  a  Markov  chain  Y  with  transition  maxtrix 
P  and  a  Poisson  process  N  with  rate  A  .  The  transient  probabil¬ 
ities  of  Y  are  denoted  4>.(n)  =  £<t>^(n),  2^n^’  •••»  >  w^ere 

<fc  (n)  =  P(Y  =s)  ,  s  £  S  .  The  randomization  formula  is 
s  n 

00 

p(x(t)  =  s)  =  l  p(x(t)=s  j  N(t)=n}pCN(t)=n] 
n=0 

00 

=  y  P(Y  =  s)pQj(t)  =  n} 

n  n 
n=0 


or  equivalently. 


l(t)  =  I  j>(n) 

n=0 


-At, . . N n 
e  (At) 

n! 


(3) 


See  Gross  and  Miller  [4]  for  additional  discussion  and  details.  (Equa¬ 
tion  (3)  can  also  be  found  in  £inlar  [1,  p.  259]  and  Keilson  [10,  Eqn.  2.1.-] .) 

The  infinite  series  in  Equation  (3)  must  be  truncated  for  computa¬ 
tional  purposes.  Let 


T(£, t)  =  min 


,  £  e"At(At)n 

n=0  n‘ 


>  1  -  E 


(4) 


where  £  equals  an  acceptable  error  (specified  by  the  user) .  The  compu 

tational  version  of  Equation  (3)  is 

_  T(e,t)  -At,,.vn  (3) 


^“(t)  =  l  ip(n) 
n=0 


e~At(flt)n 

n'. 


Truncation  of  the  infinite  series  involves  a  probability  loss  of  at  most 
E  ;  thus  all  probabilities  (of  states  or  subsets  of  states)  will  have  an 
error  between  -E  and  0.  Note  that  the  randomization  formula  (5)  re¬ 
duces  the  calculation  of  transient  probabilities  of  a  Markov  process  to 
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those  of  a  Markov  chain  and  underlying  Poisson  process,  both  of  which 
are  more  amenable  to  exact  numerical  evaluation. 

The  <j>'s  are  computed  recursively  using  the  relation  from  stan¬ 
dard  Markov  chain  theory; 

J>(0)  =  tt(0)  ;  Ji(n+1)  =  ^>(n)P  ,  n  ^  0  .  (6) 

(Note  that  Equation  (6)  involves  only  nonnegative  numbers,  a  fact  that 
contributes  to  numerical  stability  of  the  algorithm.)  The  matrix  P  is 
usually  sparse  and  thus  the  above  matrix  multiplication  should  be  per¬ 
formed  by  an  appropriate  algorithm'  Such  a  multiplication  algorithm 
(called  SERT)  is  described  by  Gross  and  Miller  [4].  The  number  of 
operations  in  this  algorithm  is  proportional  to  the  sum  of  the  number 
of  states  and  the  number  of  transitions. 

In  short,  the  standard  randomization  computational  algorithm  com¬ 
putes  A  and  P  from  the  generator  Q  using  (2).  It  computes  the 
truncation  point  T(e,t)  from  (4),  then  the  j>(n)'s  using  (6)  recur¬ 
sively,  accumulating  in  Equation  (5)  to  give  Tre(t)  . 

Gross  and  Miller  [5]  have  computed  transient  probabilities  for 
Markov  process  models  of  multi-echelon  inventory  systems  with  20,000 
states  and  100,000  transitions  using  the  randomization  algorithm. 

Melamed  and  Yadin[ll]  have  applied  the  method  to  queuing  networks  with 

a  large  number  of  states.  Miller  [12]  has  adapted  the  randomization 
algorithm  to  efficiently  handle  certain  stiff  systems  which  arise  in  the 

reliability  analysis  of  fault- tolerant  systems. 

There  are  other  numerical  approaches  to  the  solution  of  the 
Kolmogorov  equation  (1)  which  we  will  not  consider.  Two  general  ap¬ 
proaches  are:  (i)  numerical  integration  techniques  such  as  Runge-Kutta, 
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predictor-corrector,  etc.;  and  (ii)  exponentiation  [tt ( t)  =  Tr(0)e^t]  by 
computing  the  spectrum,  computing  the  Taylor  series,  or  other  means. 

The  randomization  technique  has  a  distinct  advantage  over  these  approaches 
in  that  a  bound  on  the  global  error  can  be  set  by  the  user,  and  it  is 
achieved.  (The  only  other  source  of  error  is  the  influence  of  rounding 
and  truncations  by  the  machine  performing  the  calculations;  by  noting 
that  the  randomization  algorithm  mainly  involves  multiplication  and 
addition  of  positive  numbers,  Grassmann  [3]  has  bounded  this  error.) 

Furthermore,  Grassmann  [2]  has  shown  empirically  that  randomization  is 
more  efficient  for  some  queuing  systems. 


3.  MULTI- ECHELON  REPAIRABLE  ITEM  SYSTEMS 

Multi-echelon  repairable  item  provisioning  systems  are  gener¬ 
alizations  of  the  classic  machine  repair  model.  We  consider  a  system 
consisting  of  two  bases  and  a  depot.  Each  base  has  a  certain  number 
of  "machines"  (or  key  replaceable  components  of  "machines")  assigned 
to  it  and  a  certain  desired  number  of  these  which  should  be  operating. 
Machines  fail  (independently  of  each  other)  after  being  operated  for 
an  exponentially  distributed  length  of  time.  There  are  repair  shops 
at  each  base  and  at  the  depot.  When  a  machine  fails  it  has  a  certain 
probability  of  going  to  the  base  repair  shop  for  repair;  otherwise  it 
goes  to  the  depot  repair  shop.  Each  repair  shop  has  a  certain  number 
of  repair  channels.  Repair  times  are  exponentially  distributed.  If  there 
are  more  machines  requiring  repair  than  repair  channels  at  a  given  repair 
shop,  a  queue  forms.  The  depot  repair  shop  stocks  spare  machines  which 
are  used  on  a  one-to-one  ordering  basis  to  replace  failed  machines 


coming  from  the  bases.  If  the  depot  spares  pool  is  empty  when  a 
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replacement  is  required,  a  backorder  is  created  which  will  be  filled  when 
repair  is  completed  on  one  of  the  items  in  depot  repair.  If  both  bases  are 
awaiting  backorders,  a  repaired  item  is  sent  to  the  base  with  the  maxi¬ 
mum  depot  backorders  (ties  are  broken  by  flipping  a  fair  coin) .  When 
neither  base  is  awaiting  a  backorder,  a  machine  completing  depot  repair 
is  placed  in  the  depot  spares  pool.  Thus  any  given  machine  may  be  in 
any  of  six  states  (or  equivalently" at  any  of  six  nodes  in  a  "network"): 
failed  and  in  base  repair  shop  at  either  base  (BR1,BR2);  failed  and  in 
depot  repair  shop  (DR);  operational  and  at  either  base  (BUl,BU2);  opera¬ 
tional  and  in  the  depot  spares  pool  (DU) .  These  six  states  and  the 
possible  transitions  a  machine  can  make  between  them  are  illustrated 
in  Figure  1.  The  parameters  and  variables  of  the  system  are  described 
in  Table  1.  Note  that  transportation  times  from  bases  to  base  repair 
shops  and  from  bases  to  depot  repair  shop  are  assumed  to  be  negligible. 

We  consider  adding  transportation  nodes  to  the  network  in  Section  8. 

We  shall  introduce  the  following  classification  symbology  for 
these  systems:  (//bases,  //levels  of  repair,  //levels  of  supply)  .  So  the 
system  of  Figure  1  is  considered  a  (2,2,2)  system,  since  there  are  two 
bases,  repair  facilities  at  both  base  and  depot  levels,  and  spares 
stockage  at  both  base  and  depot  levels. 

Steady-state  models  and  behavior  of  multi-echelon  inventory 
systems  are  presented  by  Sherbrooke  [15]  and  Muckstadt  [13].  In  these 
models,  they  assume  an  "infinite"  population  of  machines,  so  that  the 
system  failure  rate  is  constant,  regardless  of  the  number  of  machines 
actually  in  operation  (state-independent  failure  rate).  Further,  they 
also  assume  that  "ample"  repair  facilities  exist  so  that  failed  items 
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Figure  1.  General  schematic  for 
a  two-base  multi-echelon  repair¬ 
able  item  system. 

never  queue  in  the  repair  shops  but  go  immediately  into  service.  A  method 
for  computing  approximate  transient  performance  measures  of  the  above 
multi-echelon  system  is  presented  by  Hillestad  and  Hillestad  and  Carillo 
[8,9],  again  with  the  limiting  assumptions  of  state-independent  failure 
rate  and  ample  service.  These  two  assumptions  make  it  considerably 
easier  to  obtain  both  steady-state  and  transient  results.  Gross  and 
Miller  [5]  compute  exact  transient  probabilities  using  the  randomization 
algorithm,  explicitly  accounting  for  state  dependent  failure  rates  and 
queueing  at  the  repair  facilities.  For  further  background  on  multi-echelon 
inventory  systems,  see  the  above  references. 
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TABLE  1 

PARAMETERS  AND  VARIABLES  OF  MULTI-ECHELON  SYSTEM 


Symbol 


Definition 


a.  Parameters 


BUi 

Denotes 

units 

network 

node : 

Base 

BRi 

Denotes 

network 

node : 

Base 

DU 

Denotes 

network 

node : 

depot 

DR 

Denotes 

network 

node : 

depot 

Allocation  of  total  stocK  to  Base  i  (operating  machines  plus 
spares) ,  i  =  1 , 2 


Desired  number  of  working  machines  at  Base  i 

Number  of  repair  channels  in  repair  shop  at  Base  i 

Probability  machine  failing  at  Base  i  is  base  repairable 

Mean  failure  rate,  Base  i  items 

Mean  repair  rate,  Base  i  items 

Number  of  depot  spares 

Number  of  depot  repair  channels 

Mean  depot  repair  rate 

b.  Variables 


//BUi 

Number 

of 

//BRi 

Number 

of 

//DU 

Number 

of 

//DR 

Number 

of 

//DBi 

Number 

of 

*  -  *  ."I  *  ,  »  •  m  *>  •  «  *  *  ."‘■W  •  "  -t 

•  •  *  ,■  ,*  /  .*  «  _  ^  _  .  “,"«*»  f  •  «  ,  *  ,  •  .  ■  »  *  %  ",  * „  *.  ‘  .  ^ 
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4.  STATE  SPACE  DESCRIPTIONS  OF  (2,2,2)  SYSTEMS 

Let  us  define  the  state  of  the  system  as  the  number  of  machines 


at  each  node: 


s  =  ( //BUI ,  //BR1 ,  //BU2 ,  //BR2 ,  //DR,  //DU)  . 


The  number  of  backorders  at  the  depot  from  Bases  1  and  2,  respectively. 


#DB1  =  BS1  -  (//BUI  +  #BR1)  , 

# DB2  =  BS2  -  (//BU2  +  // BR2)  , 

where,  as  given  in  Table  1,  BS1  and  BS2  are  the  allocation  of  total 
stock  to  Bases  1  and  2,  respectively. 

In  general,  the  state  space  appears  to  have  six  dimensions,  but 
because  of  one-for-one  ordering  and  conservation  of  the  total  number  of 
items  in  the  system,  the  dimensionality  of  the  state  space  can  actually 
be  reduced. 

The  description  of  the  state  space  breaks  into  two  situations: 
(i)  no  depot  spares  available,  and  (ii)  some  depot  spares  available. 
Thus  we  break  S  into  two  parts,  namely 


5  ■  s0 V  s+ 


where 


Sq  =  states  with  depleted  depot  spares  pool 
S+  =  states  with  nondepleted  depot  spares  pool. 

First  consider  Sq  .  The  state  of  the  system  can  be  described 


with  four  numbers: 


( //DB1 ,  //BR1 ,  //DB2 ,  #BR2)  , 
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since  here  //DU  =  0  ,  and  thus 

//BUI  =  BS1  -  //DB1  -  //BR1 

//BU2  =  BS2  -  //DB2  -  //BR2 

//DR  =  DS  +  //DB1  +  //DB2  . 

The  feasible  states  of  are  subject  to  two  constraints: 

//DB1  +  // BR1  <  BS1 
//DB2  +  //BR2  <  BS2  . 

Therefore  can  be  represented  as  a  Cartesian  product. 


vvv 


where 


T  =  { (//DB1,  //BR1)  :  //DB1  +  //BR1  <  BSl} 

T0  {(//DB2,//BR2)  :  //DB2  +  //BR2  <  BS2}  . 

Figure  2  shows  a  schematic  of  the  set  of  states  of  .  The  notation 

T  is  used  because  the  spaces  and  are  triangular.  The  number 


of  points  in  and  ate 


(BS 1+1) (BS1+2) 
2 


It  I  -  (BS2+1) (BS2+2) 

I  1  2  I  2  ’ 

r.  ivoly,  and  the  number  of  states  in  is 

let  ( BS 1+1) (BS 1+2) (BS2+1) (BS  2+2) 


N'ov,  let  us  consider  the  states  where  the  spares  pool  at  the  depot 
is  not  empty,  S  .  In  this  case  the  state  of  the  system  can  be  described 
bv  three  numbers: 


(  ”BR1 ,  /fBR2 ,  //DU)  , 
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//BR1 

0  12  3  4 


if  BR2 

1  2  3  4  5 


//DB1 


0 

1 

2 

3 

4 


•  • 


//DB2 


0 

1 

2 

3 

4 

5 


•  • 


T, 


Figure  2.  An  example  of  state  space  describing  indi¬ 

vidual  bases;  here  BS1  =  4  and  BS2  =  5. 


with  constraints  on  these  given  by 

#BR1  <  BS1 
//BR2  <  BS2 
0  <  //DU  <  DS  . 

We  can  condition  on  the  value  of  if  DU  to  get  S+  as  follows. 

Let 

s+  =  sL\j  s2VJ  . .  -U  5ds  > 

where  consists  of  states  with  exactly  i  machines  in  the  depot 

spares  pool.  Note  that  each  S_^  is  a  rectangle  and  its  size  is 


Thus 


\S  \  =  (BS1+1) (BS  2+1)  . 


|S+|  =  (BS1+1) (BS2+1)DS 


and  the  total  number  of  states  is 


IS'  .  +  (BS1+I)(BS2+1)DS 

A 


(7) 
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Examples  of  state  space  sizes  are  given  in  Table  2. 

In  order  to  compute  the  probability  distribution  for  all  the 
states  at  any  continuous  time  point,  pg(t)  e  S  ,  t  e  [O,00)}  ,  we 

use  the  randomization  method  to  provide  the  computational  formulas 
and  a  technique  called  SERT  (see  [4])  which  takes  advantage  of  a 
sparse  Q  matrix  as  computational  machinery.  There  are  two  ways  to  com¬ 
pute  the  probability  distribution  for  the  CTMP  when  using  the  SERT 
technique : 

(i)  Table  look-up 

(ii)  Algorithmic  approach. 

When  using  the  table  look-up,  we  construct  all  the  target  and 
rate  vectors  and  store  them.  Any  time  that  an  event  occurs,  the  algo¬ 
rithm  goes  through  the?e  vectors  and  gets  the  necessary  information  to 
compute  the  next  discrete  time  probability  vector.  This  procedure  has 
the  undesirable  feature  that  a  huge  amount  of  the  main  memory  is  needed 
(in  fact  the  memory  needed  is  approximately  twice  the  product  of  the  number 
of  different  event  types  and  the  size  of  the  state  space) .  Consequently, 
we  are  limited  in  the  size  of  problem  that  we  are  able  to  run. 

When  using  the  algorithmic  approach,  we  calculate  the  transition 
rates  and  the  target  states  each  time  an  event  of  the  underlying  Poisson 
process  occurs.  While  this  algorithmic  approach  does  not  consume  the 
same  vast  amounts  of  memory  space  as  the  table  look-up  method,  the  algo¬ 
rithmic  approach  becomes  quite  uneconomical  with  respect  to  CPU  time. 
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TABLE  2 


SIZE  OF  THE  STATE  SPACES  OF  (2,2,2)  SYSTEMS 
FOR  SELECTED  VALUES  OF  BS1,  BS2,  AND  DS 


BS1 

BS2 

DS 

+ 

o 

l*J 

=  \s\ 

2 

2 

2 

36 

18 

54 

4 

4 

2 

225 

50 

275 

6 

6 

2 

784 

98 

882 

8 

8 

2 

2025 

162 

2187 

10 

10 

2 

4356 

242 

4598 

12 

12 

2 

8281 

338 

8619 

18 

18 

2 

36100 

722 

36822 

24 

24 

2 

105625 

1250 

106875 

It  becomes  clear  that  for  this  class  of  problem  (Markovian 
with  large  state-space),  if  we  want  to  get  exact  solutions  (within  a 
prespecified  error  tolerance)  using  the  existing  tools,  we  confront 
either  the  computer's  main  memory  restrictions,  or  the  high  cost  of  CPU 
time . 

The  question  that  naturally  comes  up  is:  Can  we  find  another  way 
to  estimate  (within  a  prespecified  error  tolerance)  measures  of  interest 
such  as  the  availability  of  a  desired  number  of  machines  at  time  t  ? 

It  would  be  reasonable  to  expect  that,  for  a  system  that 
initially  starts  at  full  strength  (all  machines  operational),  the  prob¬ 
ability  will  be  concentrated  among  only  a  relatively  small  part  of  the 

whole  state  space  during  a  mission  period  (or  period  of  interest) ,  if 
the  traffic  intensities  are  low  and  the  mission  periods  are  relatively 
short.  In  other  words,  we  should  be  able  to  truncate  the  state  space 
and  consider  only  those  states  among  which  we  believe  almost  all  the 


probability  to  be  distributed. 
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The  truncated  states,  on  the  other  hand,  are  "lumped"  into  one 
or  more  states,  which  can  be  treated  as  absorbing  states.  If  the  prob¬ 
ability  of  visiting  any  of  those  truncated  states  (probability  of  being 
absorbed)  is  negligible  during  the  mission  period,  then  the  analytical 
measures  estimated  are  almost  exact.  Further,  we  will  know  the  addi¬ 
tional  error  introduced  in  our  measures,  as  this  will  be  the  absorption 
probability.  However,  there  are  two  major  questions  that  must  be 
addressed:  How  will  we  truncate  the  state  space?  In  which  cases  will  the 
truncation  procedure  perform  satisfactorily? 

5.  TRUNCATED  STATE-SPACE  APPROACH 

Figure  3  shows  a  schematic  of  the  state  space  representation  for 
a  (2,2,2)  system.  Recall  that 

DS 

S  ■  h  *  T2^  VA  -  W  S+  • 

Assume  that  we  truncate  the  state  space  as  shown  in  Table  3.  Then  the 
truncated  state  space  will  look  like  that  shown  in  Figure  4.  The  truncated 

TABLE  3 

TRUNCATION  OF  STATE  SPACE 

For  Variable  In  Portion  of  State  Space  Truncated  Beyond 


//  DB1  T  TDB1 

IfB  R1  T  TBR1 

//DB2  T2  TDB2 

//BR2  T2  TBR2 

//BR1  S+  TBR1  ' 

//BR2  S+  TBR2 ' 
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0  12  3 


0  12  3  4 


0  12  3  4 


x  §  DB2 


DS 

+  \J  #BR1 

i=l 


Figure  3.  Full  state-space  representation  for  a  prob¬ 
lem  where  BS1  =  3  and  BS2  =  4. 


0  12 


Q  1  2 


0  12  3 


0  x  #DB2 


DS  o 

+  W  //BRl  , 
i=l 


Figure  4.  Truncated  state  space,  where  TDB1  =  1, 

TBR1  =  2,  TDB2  =  2,  TBR2  =  2,  T3R1'  =  2, 

rrnj-nr)  |  «  -tBR  -J-B  0  -j-R  R 

TBR2  =  3.  The  states  T  ,  T  ,  T  , 

rB0  CBR2  CBR1  .  ^ 

i 2  ,  are  absorbing  states. 


states  are  lumped  into  six  absorbing  states.  Whenever  there  is  a 
transition  from  the  remaining  state  space  into  a  truncated  state,  it  will 
be  considered  as  a  transition  to  a  specific  (absorbing)  state  which, 
once  visited  by  the  process,  will  never  be  left.  The  size  of  the  state 
space  (excluding  the  absorbing  states)  is  now  reduced  to 

S  =  (TDB1+1)  •  (TBR1+1)  *  (TDB24-1)  *  (TBR2+1)  +  DS*  (TBR1  ’+1)  •  (TBR2  ’+1)  . 
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The  benefits  of  truncating  the  state  space  are  readily  apparent. 
First,  we  decrease  significantly  the  amount  of  computer  memory  required 
(e.g.,  we  need  to  consider  only  a  fraction  of  the  whole  state  space). 
Secondly,  by  this  method  we  are  able  to  calculate  the  total  absorbed 
probability  or,  in  other  words,  the  amount  of  total  error  added  because 
of  absorption.  Thirdly,  CPU  time  for  the  execution  of  the  algorithm 
is  reduced  because  it  depends  approximately  linearly  on  the  size  of 
the  state  space.  This  approach  can  also  be  utilized  when  treating 
certain  infinite  state-space  CTMP's,  for  example  M/M/c/00  queues  or 
open  queuing  networks. 

6.  ESTIMATION  OF  INITIAL  TRUNCATION  POINTS 

Now  that  the  algorithm  is  established,  the  only  step  needed  before 
it  can  be  implemented  is  the  selection  of  the  truncation  points.  To  do 
this,  we  look  at  our  (2,2,2)  system  as  three  independent  M/M/l/°o  queues, 
the  traffic  intensities  of  which  are  made  equal  to  the  traffic  intensities 
of  the  three  stations  of  our  original  problem.  We  define  traffic  intensi¬ 
ties  for  our  state-dependent  original  problem  as  the  maximum  possible  load 
namely,  A  .MS  .ot . /u  .BC .  for  the  bases  and  J.  A .MS . (1-a . ) /p_DC  for  the 
depot.  We  mention  here  that  three  independent  queues  are  not  in  general  a 
good  approximation  for  our  true  multi-echelon  queueing  network,  but  will 
serve  our  purpose  for  providing  reasonable  values  for  initial  truncation 
points,  and  is  used  only  for  this  purpose.  Once  the  state  space  is  trun¬ 
cated,  randomization  SERT  is  applied  to  the  original  multi-echelon  network 
The  question  that  now  arises  is:  What  is  the  smallest  n  ,  such  that 

Pr  {an  M/M/l/^  queue  visits  state  n  or  higher  during  [ 0 , t  ]  }  <  6  , 
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where  t  is  the  mission  time.  The  n  estimated  this  way  will  qualify 
m 

as  the  appropriate  initial  truncation  point.  As  a  side  observation, 

Pr{an  M/M/I/00  visits  n  or  higher  during  [0,t  ]} 

m 

=  Pr{an  M/M/l/n  vtsits  n  during  [0,t  ]}  . 

m 

Using  randomization  SERT,  we  calculate  the  absorbing  probabilities 
as  functions  of  time  and  truncation  point  for  different  traffic  inten¬ 
sities,  ranging  from  .2  up  to  .7  (see  the  appendix).  It  turns  out 
that  as  the  truncation  point  n  increases,  the  absorbing  probability 
as  a  function  of  time  becomes  linear,  with  slope  equal  to  1  (on  a  £n-£n 
scale)  and  intercept  dependent  on  the  traffic  intensity  and  the  truncation 
point  n  . 

The  graphs  calculated  for  M/M/l/n  queues  as  given  in  the 

appendix  are  based  on  a  randomization  cut-off  error,  £  ,  of  10  ^  . 

These  can  be  used  to  satisfactorily  estimate  truncation  points  even 

for  systems  with  more  than  one  server,  provided  that  the  "match"  of 

traffic  intensities  is  maintained,  that  is,  the  single-server  service 

rate  is  set  equal  to  the  sum  of  the  multiple  servers  service  rates. 

If  the  traffic  intensities  are  relatively  low  (which  they  often  are  in 

multi-echelon  repairable  inventory  systems),  and  the  mission  period  short 

(t  small),  then  the  truncation  technique  should  work  in  the  sense  that 
m 

the  truncation  points  decrease  the  number  of  states  to  be  considered  to 
a  dimension  that  the  computer  memory  can  handle  (in  Section  9,  we  discuss 
this  further).  Otherwise,  system  approximation  techniques  such  as  de¬ 
composition  into  independent  queues  or  approximation  by  Jackson  networks, 
or  simulation.  Cross,  Miller,  and  Plastiras  [hi  give  a  comparison  of 
randomization  and  simulation,  including  CPU  times  for  comparable  accuracies. 
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Their  general  conclusion  was  that  for  smaller  state  spaces  and  for 
higher  precision,  randomization  is  more  economical.  For  example,  to 
obtain  a  precision  of  ±1%  with  99%  confidence  using  simulation  turned 
out  to  require  three  times  as  much  CPU  time  as  randomization  for  a 
15000-state  problem. 
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7.  EXAMPLES 

We  present  two  examples,  one  of  a  (2,2,2)  system  and  another 
of  a  (3,2,2)  system,  which  show  the  effectiveness  of  the  truncation 
approach. 


Example  1. 

Let  us  consider  the  (2,2,2)  system  shown  in  Figure  5.  The 
full  state  space  for  this  problem  is  77,234  states.  Using  the  table 
look-up  algorithm,  it  is  impossible  to  handle  this  problem  on  the 
VAX  11/780  system  without  truncation.  We  desire  availability 
measures,  where 

Availability  at  time  t  for  Base  i  =  A. (t)  =  £  p.  .(t)  , 

1  3  » l 

j=MS1 

where  p  (t)  is  the  probability  that  j  machines  are  working  at 
J » 1 

Base  i  at  time  t  .  We  also  desire  the  total  probability  of  absorption 
during  the  mission  time  t  (which  for  this  example  equals  30)  to  be  less 
than  .015. 


To  evaluate  the  initial  truncation  points,  for  Base  1  the 


traffic  intensity  is 

O^AjMSl 
P1  =  BClp 


.6(. 15)20 
4.5 


0.4  . 


When  we  calculate  the  graphs  of  the  absorbing  probabilities  for  differ¬ 
ent  cases  of  traffic  intensity  p  ,  we  assume  A  =  p  and  p  =  1  (we 
refer  to  p  =  1  as  the  "nominal"  value).  In  general,  y  is  not  1  and  we 
must  adjust  our  time  scale  accordingly  to  match  event  rates.  The  absorbing 
probabilities  at  time  t  for  an  M/M/1  system  with  traffic  intensity 
p  =  kA/ku  is  the  same  as  the  absorbing  probability  at  time  kt  for  a 
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BR1 

a^=.  6 

Base 

1 

1  server 

20  operating 

2  spares  • 

Uj,  =  A. 5 

BR2 

Al=° 

Base 

.15 

2 

1  server 

-  1 

a„=.  2 

20  operating 

2  spares 

\ 


DR 


DU 


1  server 


2  spares 


=  3.33 


U2  =  °-5 


X2  =  0.05 


Figure  5.  (2,2,2)  example. 


system  with  p  =  A/y  ,  since  these  two  systems  yield  the  same  expected 
number  of  events  over  their  respective  time  intervals,  namely,  t(kA  +  ky)  = 
(kt)(A  +  y)  .  Thus,  while  we  are  interested  in  a  mission  time  of  30,  our  y 
is  4.5,  not  1,  so  k  =  4.5  and  the  "equivalent"  mission  time  is  4.5(30)  = 
135  .  Using  our  graphs  in  the  appendix,  given  that  p  =  0.4  ,  we  wish  to 
find  the  smallest  n  ,  such  that  Pr{an  M/M/l/n  visits  n  in  time  period 
[0,135]}  <  .005  .  We  obtain  an  n  of  9,  so  that  TBR1  =  9  ,  and  TBR1 '  =  9 
will  serve  as  our  initial  truncation  points  for  the  state  variable  /IBP  1 
for  the  Sq  and  S+  portions  of  the  state  space,  respectively. 

Similarly,  at  Base  2  the  traffic  intensity  P2  is: 

„  _  a2A2MS2  .2(. 05)20  „  , 

P2  ~BC2y^_  =  - T5 -  =  °'4  * 

Now  here  the  event  rate  is  1/2  *  nominal  (since  U2  =  -5);  therefore,  we 
look  at  the  graphs  and  tables  where  p  =  .4  and  seek  the  smallest 
n  such  that  Pr{an  M/M/l/n  visits  n  in  time  period  [0,15]}  ^  .005  . 

We  obtain  n  =  6  ;  thus  TBR2  =  6  ,  and  TBR2 '  =  6  will  serve  as  our 
initial  truncation  points  for  the  state  variable  //BR2  for  the 
Sq  and  S+  portions  of  the  state  space,  respectively. 
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We  now  consider  the  depot.  The  traffic  intensity  p  is 

D 

(l~°‘l>Xl”S1  +  <1“a2)X2MS2  ,4(. 15)20  +  .8(. 05)20  n  . 

PD*  d3T  T333 - °'6 


Here,  the  rates  are  3.333  *  nominal  (because  y  =  3.333)  ; 
therefore,  we  look  at  the  tables  and  graphs  where  p  =  .6  ,  and  pick 
the  smallest  n  such  that 

Pr{an  M/M/l/n  visits  n  in  time  period  [0,100]}  <  .005  . 

We  obtain  n  =  14  ,  which  serves  as  the  truncation  point  for  the  number 
of  machines  undergoing  repair  in  the  repair  facility  at  the  depot. 

Our  aim  is  to  fix  truncation  points  for  the  number  of  machines  that 

the  depot  owes  to  each  base.  Given  that  DS  =  2  ,  the  total  number 

of  machines  owed  by  the  depot  to  the  bases  is  14  -  2  =  12  .  Now, 
we  need  to  divide  this  number  into  two  numbers,  which  will  serve  as 
the  truncation  points  for  the  depot  backorders  in  Base  1  and  Base  2, 
respectively.  One  way  to  "allocate"  is  to  divide  the  total  according 
to  the  ratio  of  the  failure  rates  of  the  bases  to  the  depot.  In  our 
example  we  divide  the  12  machines  as  follows.  The  failure  rate  to 
depot  from  Base  1  is  .4  x  20  x  ,15  =  1.2  and  from  Base  2  is 
.8  x  20  x  .05  =  0.8  .  The  total  is  2.0  and  the  allocation  then  is 

TDB1  =  (1.2/2) (12)  =  7  and  TDB2  =  (0.8/2) (12)  =  5  . 

The  truncated  state  sparo  now  looks  like  that  shown  in  Figure  6. 

In  Table  4  we  can  see  the  number  of  states  considered  for  the 
truncated  state  space,  and  their  respective  absorbing  probabilities. 

The  entries  in  the  first  row  correspond  for  the  case  where  the  trun¬ 
cation  points  are  the  same  as  in  Figure  6.  After  examining  the 

BO 

absorbing  probabilities  we  find  the  probability  of  relatively 
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high.  Since  we  would  like  the  total  absorbed  probability  to  be  less 
than  .01,  we  increase  TDB2  from  5  to  6,  and  rerun  the  algorithm  with  the 
results  shown  in  the  second  row  of  Table  4. 

One  might  ask  whether  the  M/M/l/°°  approximation  can  help  in 
estimating  truncation  points  for  problems  where  there  is  more  than  one 
server  in  the  repair  shop.  To  show  that  it  can,  Rows  3  and  4  in  Table  4 
correspond  to  two  additional  runs  in  which  we  retain  the  truncation  points 
of  the  Row  2  example  based  on  the  M/M/l/°°,  but  wnere  we  try  two  and  then 
three  service  channels  at  each  base  repair  facility,  reducing  the  service 
rate  of  each  of  the  multiple  channels  appropriately  to  yield  an  equivalent 
service  rate.  Row  5  lists  results  of  an  additional  run  where  the  number 
of  service  channels  at  Base  1  and  Base  2  repair  are  3  (the  Row  4  case) , 
but  where  TBR2'  has  been  increased  to  7  in  order  to  reduce  the  absorption 
error  closer  to  the  desired  .01  value. 


Example  2. 

We  now  consider  a  (3,2,2)  system  as  shown  in  Figure  7.  The  full 
state  space  size  can  be  found  by  generalizing  the  formula  for  the  two  base 
case.  Here  we  have  the  Cartesian  product  of  three  triangles  (one  corres¬ 
ponding  to  each  base)  for  the  part  of  the  state  space,  and  the  union 
of  DS  cubes  for  the  S+  part  of  the  state  space.  Hence, 

|S|  =  (BS1+1)  x  (BS1+2)  x  (BS2+1)  x  (BS2+2)  x  (BS3+1)  x  (BS3+2)/8 
+  DS  x  (BS1+1)  x  (BS2+1)  x  (BS3+1)  . 

Using  the  above  formula  for  this  example,  the  full  state  space  is 
43,278,703  states.  Going  through  the  same  procedure  used  for  the  pre¬ 
vious  example,  we  set  our  initial  truncation  points  using  the  graphs 
given  in  the  appendix  and  obtain  values  shown  in  Figure  8. 


'•  "•  v  JV  . 


Table  5  lists  the  number  of  states  of  the  truncated  state  space 


considered,  and  the  absorbing  probabilities.  The  first  row  exhibits 
results  based  on  the  truncation  points  chosen  initially  (as  shown  in 
Figure  8)  .  Observe  that  and  have  the  higher  ab¬ 

sorbing  probabilities.  After  increasing  TBRl'  ,  TBR2'  and  TBR3' 
from  6  to  8,  we  reran  the  problem  with  the  results  shown  in  Row  2  of 
Table  5  and  the  total  absorbed  probability  drops  below  .01. 


8.  MORE  COMPLEX  SYSTEMS 

We  now  consider  the  following  three  models,  which  are  more  complex 
variations  of  the  models  having  two  bases  and  two  echelons: 

(i)  Model  with  transportation  pipelines, 

(ii)  Model  with  two  types  of  spares, 

(iii)  Model  with  intermediate  repair  shop  (three  echelons). 

Model  with  Transportation  Pipelines 

A  schematic  of  such  a  system  is  shown  in  Figure  9.  This  model  has 
two  bases,  two  levels  of  supply,  and  two  levels  of  repair,  and  serves  as 
a  prototype  for  analyzing  transportation  pipelines.  There  is  only  one 
additional  characteristic  that  distinguishes  the  model  of  Figure  9  from 
the  (2,2,2)  system  previously  studied.  Failures  from  base  to  the 
depot  enter  a  single  pipeline  (denoted  by  PIN) ,  and  repairs  of 
backordered  machines  enter  either  one  of  two  pipelines  (denoted  by 
P10UT  and  P20UT)  depending  on  to  which  base  they  are  sent.  In  order 
to  describe  the  state  space  for  this  model,  we  will  condition  on  the 
number  of  spares  available  at  the  depot: 
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(i)  Spares  available  at  depot  =>  DU  >  0  . 

If  spares  are  available  in  the  depot,  then  whenever  a  machine 

enters  the  PIN  pipeline,  another  machine  enters  either  the  P10UT  or 

the  P20UT  pipeline  at  the  same  time.  The  number  of  backorders  for 

each  base  will  be  at  level  0  ,  so  that  the  total  number  of  machines 

allocated  to  each  base  (BSi)  w-ill  be  distributed  in  the  [aa]  or 

[bb]  portions  of  the  network.  The  conditions  for  #DU  >  0  are 

//BR1  +  //BU2  +  //P10UT  =  BSI 

//  BR2  +  //BU2  +  //P20UT  =  BS2 

//PIN  +  //DR  +  //DU  =  DS  , 

and  the  total  number  of  states  is: 

DS ( DS+l)  v  (BS1+1) (BS1+2)  (BS2+1) (BS2+2) 

2  2  *  2  ‘ 

(ii)  Spares  not  available  in  depot  =>  //DU  =  0. 

For  this  case, 

DS  <  //PIN  +  //DR  <  BSI  +  BS2  +  DS  , 

in  fact,  //PIN  +  //DR  =  //DB1  +  //DB2  +  DS  (where  //DB1,  // DB2  are  the 
numbers  of  backorders  at  the  depot  from  Bases  1  and  2,  respectively) . 
If  we  let 

j  =  BSI  -  //DB1 

k  =  BS2  -  //DB2  , 

then  the  total  number  of  states  is: 

l  h+l'>  (]+2')  x  £  (Jc+D  (k+2)  x  [DS+(BS1_j)+(BS2~k)+l] 
j=0  k=0 


-  30  - 


T-488a 


3 


Thus,  the  total  state  space  size  is  given  by: 


Is!  = 


DS(DS+1)  „  (BS1+1) (BS 1+2)  v  (BS2+1) (BS2+2) 


BS1  BS2  (i^l)  (ix+2)  (i2+l)(i2+2) 

+  L  L  ^  x - ~ - 


i1=0  i2=0 


x  [DS+BSl+BS2-i^-i2+l] j . 


Examples  of  state  space  sizes  for  the  above  model  are  given  in  Table  6. 

Model  with  Two  Types  of  Units 

We  show  schematically  in  Figure  10  an  example  with  two  different 
types  of  machines  or  components.  This  model  is  the  same  as  the 
(2,2,2)  prototype  except  that  we  now  have  two  types  of  machines  (or 
assemblies,  say  A  and  B) .  Given  that  they  are  independent  components, 
we  can  easily  derive  the  formula  for  the  state  space  of  the  model  of 
Figure  10  as  follows: 

|S  |  -  [(BSlA+I).(BSlA+2)  „  CBS2A+1)_(BS2A+2)  +  DSA(BS1A+1) (BS2A+1) 

x  (8S1B+1HBS1B+2)  x  (BS2B+1HBS2B+2)  +  DSB(BS1B+1) (BS2B+1) 

Table  7  exhibits  state  space  sizes  for  different  sizes  of  the  above 
model. 


Model  with  Intermediate  Repair  Shop 
(Three  Levels  of  Supply  and  Repair 


■ 

<r 

We 

show  in  Figure  11  a  (4,3,3)  system.  We 

let 

ISi 

be  the 

number 

of 

spares 

allocated  to  intermediate  station 

i  , 

//lUi 

the 

• 

* 

*  F 

m 

number 

of 

spares 

available  at  intermediate  station 

i  , 

and 

//IRi 

i 

be  the 

number  in 

or  awaiting  repair  at  intermediate 

station 

i  . 

-  •  k 
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BS1A 

2 

2 

4 

4 

4 

8 

8 


TABLE  6 

STATE  SPACE  SIZES  FOR  THE  MODEL 
WITH  TRANSPORTATION  PIEPLINES 


BS1 

BS2 

DS 

Number  of  States 

1 

1 

1 

49 

2 

2 

2 

508 

4 

4 

2 

6,800 

6 

4 

2 

17,430 

6 

5 

2 

28,812 

6 

6 

2 

44,688 

8 

8 

3 

229,950 

16 

12 

3 

4,933,383 

24 

18 

4 

60,916,375 

TABLE 

7 

STATE  SPACE  SIZES  FOR  TWO  ITEM- TYPE  SYSTEM 

BS2A 

3 

3 

4 

4 

5 
8 
8 


BS1B  BS2B  DSA 

2  3  2 

3  4  2 

4  4  2 

6  6  2 

6  7  2 

8  8  2 

10  10  2 


DSB  Number  of  States 

2  7,006 

3  17,640 

2  75,625 

2  242,550 

3  441,000 

2  4,782,969 

2  10,055,826 
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We  now  condition  on  the  number  of  spares  available  at  the  depot 
(as  before,  DS  represents  the  number  of  spares  allocated  to  the  depot 
and  BSi  the  total  number  of  machines  allocated  to  Base  i) . 


(i)  )/DL'  >  0  . 

In  this  case,  we  have  two  independent  (2,2,2)  models,  with 
two  echelons  and  two  bases.  Thus 

|S+[  =  DS  x  [(IS1) (BS1+1) (BS2+1)  +  (BS1+1 ) (BS1+2) (BS2+1) (BS2+2) /4 ] 
x  [ (IS2) (BS3+1) (BS4+1)  +  (BS3+1) (BS3+2) (BS4+1) (BS4+2)/4] 


(ii)  it  DU  =  0  (  no  spares  available  at  depot)  and  the  depot 

owes  i  IL'l  spares  and  ]  TU2  spares. 

We  first  focus  on  the  [aa]  portion  of  the  network. 

(a)  0  <  i  <  IS1 


1.  //IU1  >  0  . 


Then  we  have  to  consider  ^  (BS1+1)  (BS2+1)  (ISl-i) 


s  tates . 


// IU1  =  0  . 


Then  BSI  +  BS2  4-  IS1  -  i  machines  have  to 


be  allocated  to  the  five  stations  contained  in 
area  [aa]  of  Figure  11.  So  we  consider 
IS1-2 

l  ll  (k+1)  (k+2)U+l)(£+2)/4 
i=0  k  l 


states,  where 


k  =  number  of  machines  at  Base  1 


l  =  number  of  machines  at  Base  2 
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and  the  double  sum  is  conditioned  on 

0  <  k  +  £  <  BS1  +  BS2  +  IS1  -  i 
0  <  k  <  BS1 
0  <  -£  <  BS2 

(b)  IS1  <  i  <  BS1  +  BS2  +  ISj 

Here,  we  know  that  #IU1  =  0  .  So  the  number  of 
states  to  be  considered  is 


BS1+BS2+IS1 

l  ll  (k+l)(k+2)(£+l)(£+2)/4  , 

i=ISl  k  £ 

where  the  double  sum  is  conditioned  on 
0  <  k  +  £  <  BS1  +  BS2  +  IS1  -  i 
0  <  k  <  BS1 
0  <  £  <  BS2  . 


We  are  now  able  to  write  the  formula  giving  the  number  of  states 
of  the  entire  state  space: 

\S\  =  DS  x  [JS1(BS1+1) (BS2+1)  +  (BSl+l) (BS1+2) (BS2+1) (BS2+2) / 4 ] 
x  [IS2(BS3+1)(BS4+1)  +  (BS3+1) (BS3+2) (BS4+1) (BS4+2) /4 ] 


IS1-1 

l  [(BSl+l) (BS2+1) (ISl-i)] 
i=0 


min(BSl ,BSl+BS2+ISl-i)  min(BS2 ,BSl+BS2+ISl-i-k) 

+  l  l  1 

0<i<BSl+BS2+ISl  k=0  £=0 


(k+l)(k+2)(£+l)(£+2) 

4 


A 


IS2-1 

l  [ (BS3+1( (BS4+1) (IS2-i) ] 

i=0 


min(BS3,BS3+BS4+IS2-i)  min(BS4 ,BS3+BS4+IS2-i-k) 

l  l  l 

0<i^BS3+BS4+IS2  k=0  £=0 

(k-4-1)  (k+2) (£+!)( £+2) 

4 


36 
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Table  9  gives  some  examples  for  different  cases  of  the  above  model. 

9.  CONCLUSIONS 

We  can  see  that  the  truncation  technique  works  for  rather  large, 
single-item,  two-echelon  Markovian  systems.  The  applicability  of  the 
technique  basically  depends,  for  each  individual  case,  on  the  rates  and 
the  mission  times. 

Figure  12  gives  an  idea  of  which  rates  will  be  acceptable  if  we 
wish  to  have  an  M/M/l  system  probability  of  "overflowing"  a  certain 
n  (=  number  in  system)  of  .005  in  30  time  units;  that  is,  points  on  each 
contour  correspond  to  points  for  which  n  is  overflowed  in  30  time 
units  with  probability  .005.  Points  below  this  specific  contour  give 
absorbing  probability  less  than  .005  in  30  time  units.  For  instance, 

TABLE  9 

STATE  SPACE  SIZE  FOR  INTERMEDIATE  REPAIR  SYSTEM 

BSl  BS2  IS1  BS3  BS4  IS2  DS  Number  of  States 


o 
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in  Example  1,  we  came  up  with  a  Base  1  repair  truncation  point,  TBR1, 
of  9.  Now,  if  we  still  wish  to  have  the  system  run  for  30  time  units 
and  the  absorbing  probability  for  to  be  ^  .005  then,  using  Figure 

12,  we  show  that  the  arrival  and  failure  rates  that  will  suffice  are 
those  below  the  contour  for  n  =  9  .  So  according  to  this  figure,  our 
rates  of  "A"  =  a  A  MSI  =  1.8  and  "y"  =  c^  =  4.5  will  do,  because 
this  point  is  not  above  this  contour.  However,  if,  for  example, 

O^A  MSI  =  8  and  c^  =  15  ,  then  TBRl  =  9  will  not  do  because  the 
point  made  up  of  these  rates  lies  above  the  n  =  9  contour. 

This  figure  can  also  be  used  for  mission  times  other  than  30  time 
units  by  scaling  the  rates  appropriately.  For  example,  if  we  are 
interested  in  a  mission  time  equal  to  15  time  units  with  a^A^MSl  -  1.8 
and  c^U^  =  ^ anc^  we  desire  to  know  whether  TBFJ.  =  7  might  be  a 
good  truncation  point  (so  as  to  allow  the  probability  at  absorption 
to  be  less  than  .005)  then,  knowing  that  this  is  equivalent  to  a  system 
with  mission  time  equal  to  30,  and  a  A^MSl  =0.9  ,  c^y^  =  2.25  and 
using  Figure  12,  we  see  that  we  are  above  the  contour  for  n  =  7  ,  and 
as  a  consequence  it  is  not  an  appropriate  truncation  point.  However, 
TBRl  =  9  would  certainly  work  here  since  the  point  is  below  that  con¬ 
tour.  In  fact,  if  a  truncation  point  is  satisfactory  for  a  mission 
time  t  ,  it  will  certainly  be  satisfactory  for  mission  times  less  than 
t  .  The  opposite  is  not  necessarily  true. 


Thus ,  if  one  has  an  idea  of  the  total  number  of  states  that  can 
be  handled  on  a  particular  computer,  using  the  state  space  size  formulas 
[for  example,  equation  (7)]  can  give  rough  ideas  of  what  the  truncation 
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points  must  be  for  the  computer  to  be  able  to  handle  the  problem. 

Using  Figure  12  in  the  manner  illustrated  above  will  indicate  whether 
these  truncation  points  are  adequate  for  the  rates  of  the  partic¬ 
ular  system  under  study. 

The  more  complex  models  reflected  in  state  space  sizes  given 
in  Tables  7,  8  and  9  can  tax  even  the  truncation  technique.  Trun¬ 
cation  might  be  feasible  for  the  pipeline  models  as  the  state  space 
does  not  blow  up  too  rapidly  (see  Table  7).  However,  the  multi¬ 
machine  and  intermediate  repair  types  of  models,  except  for  perhaps 
relatively  small  systems,  generally  have  state  spaces  which  are  too  large 
for  even  truncation  to  handle,  and  which  would  have  to  be  analyzed  by 
other  techniques,  such  as  simulation  or  approximation  with  simpler 
systems.  Nevertheless,  this  truncation  technique  can  handle  systems 
large  enough  to  model  many  realistic  size  problems  of  the  real  world. 
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Figure  A6 .  Absorbing  Probability  vs.  Time  for  p  =  0.7  ,  truncation 
points  of  1  to  37  inclusive. 


Base 


■(■■■Ml 


MUIBIIMI 


■  ill 
III 


III! 


min 

linn 


■■■■«■■■■■! 

■■■■■■■■■■■I 

lll■■■l■■■■l 


IIMI 


»■■■■■■■ 


MBBMMI 


iiinmH 


IIIIHIIIHI 


NHMIIMMBM 


llllllllll 


■■■■■■■I 


iiimniKiimBBiiiminnn 


ihmi 


^WMinimm 
MWMMiniaw 
rXYWllllllMI 

■^xwtiiiini 

■teiiiin 


II— ■— IMMIUMB 


■mni\\\\m«mni 

■■■■■■lixxwmmwiiiu 

iiuhii^\vkm|||||I 


(■■■■ 


iiiMinWiimmwNi 


nuniniH«iVk%M 


yuumunn 


MlkllllllllMH 


jSaa|S|5jg|||aj|^^a5^p^ja^S5 

■■■m— mmimb 

MMMigMiBBHHBiiiggg^MiiMMiBSwBiSSSiaSSB 

llll■l■■■■M«lll■lll■■■■HIII■■lll■■■■■■lll■■lll■SdS5 


rsi  • 


aWl 


500  1000  5000  10000 


0000 l  0001 


tIM'll 


InraSSSSSSSS 

UllKWIKm 

fimnKSSiSKaSiSS 

I  n«wmmw 


M 


■■Ml£UKJiKVK«mi»S«K»HI 

■■iiMPiaHH 

i  mi 


!i«MiniKuraMM»iMiK«Brara 


I  iiiTi  ui  ■■  —  i 

kVlWUVKIM 


M 


imSIKMi 

[■•Vamik'MIk'WBkM 

L'Sr&ISfi&SB&SB&a 


wrarauamsi 

■jiwi  »■■>!■— I 


ikwkwB 

iiwmnm 


iir 


kiwkmai 


■Nlkil 


IHM 


Ml 


umiMM 


Ml 


IM 


U'WI 


IMMI 


IMI 


SWHKMKkMI 


ini: 


■k?iK<a 
IWIKI 


KwvsictiasisnnsaiSissKSi 


HBUCIKMai 


liuuwSwvlMHS 

nimjgjgwi 

ItUte-  -—:- 


Lm'WkmniM 


Ml 


JiiwkMrara 

SiwuiMaan 


^IMIW'UMBk.W 

aiSSSaiSiSifS 

klKlklKIkVl 
«k!IKW5Ka^S 
MK«»K«£1 


Kami 


Kl 


tmmMmmm 


h«.«i 
linu 

Itua _ 

nvuikiwi 

-*  '-rJ  .Lr |  *&  -A' 

III 
■If 

M 


^K»K»ISII 


Silii 


;ilSlli»KS!iB!fiiSSIii:9IBS^SSSiISS&lSSl 


ln—wi 

|n«l|| 

mi 
liiki 


Eniik 

IhS»!mis9 


■■■ 


iBiMiiMmi 

IHIftaaMK 


(■■i 


IfiSUIIII 


*—  co  ud  *~r 

o  o  o  o 

•  o  o  o 


X4.1  jiqDqoj^  Suiqjosqv 


■Vlv'-  •£+itir¥lfa  I/-, •* vV'vC^ 


t:*  v '  -  ■  -/■ 


